Papers with grounding language
LIA: A Natural Language Programmable Personal Assistant (D18-2)
Copied to clipboard
| Challenge: | a prototype of an intelligent personal assistant can be programmed using natural language . a user can instruct her assistants using language similar to how humans teach other humans . |
| Approach: | They present LIA, an intelligent personal assistant that can be programmed using natural language. LIA resides on a typical mobile Android device. |
| Outcome: | The proposed system can be programmed using natural language, and it can perceive the external environment through sensors and effectors. |
Mapping natural language commands to web elements (D18-1)
Copied to clipboard
| Challenge: | a dataset of over 50,000 natural language commands captures various phenomena, including functional references, relational reasoning, and visual reasoning. |
| Approach: | They propose a task that requires the user to choose the correct element on a web page . they use a dataset of over 50,000 natural language commands to map these to web pages . |
| Outcome: | The proposed task can be viewed as a reference game based on a dataset of over 50,000 natural language commands . |
ReSeeding Latent States for Sequential Language Understanding (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing grounding approaches depend on auxiliary modules at inference or implicitly align encoder-only models that lack generative capacity. |
| Approach: | They propose a method that produces latent embeddings aligned with the true state of the environment and refeeds these embeddables into the model before generating its output. |
| Outcome: | The proposed method outperforms commercial LLMs on three new reasoning benchmarks. |